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We present a search for charged Higgs bosons in top quark decays. We analyze the e+jets, 
^i+jets, ee, e/i, nfj,, re and r/x final states from top quark pair production events, using data from 
about 1 fb _1 of integrated luminosity recorded by the DO experiment at the Fermilab Tevatron 
Collider. We consider different scenarios of possible charged Higgs boson decays, one where the 
charged Higgs boson decays purely hadronically into a charm and a strange quark, another where 
it decays into a r lepton and a r neutrino and a third one where both decays appear. We extract 
limits on the branching ratio B(t — > H + b) for all these models. We use two methods, one where the 
tt production cross section is fixed, and one where the cross section is fitted simultaneously with 
B(t — > H + b). Based on the extracted limits, we exclude regions in the charged Higgs boson mass 
and tan /3 parameter space for different scenarios of the minimal supersymmetric standard model. 

PACS numbers: 13.85.Lg, 13.85.Qk, 13.85.Rm, 14.65. Ha, 14.80.Cp 



I. INTRODUCTION 



In many extensions of the standard model (SM), in- 
cluding supersymmetry (SUSY) and grand unified the- 
ories, the existence of an additional Higgs doublet is 



required. Such models predict multiple physical Higgs 
particles, including three neutral and two charged Higgs 
bosons (H^) If the charged Higgs boson is sufficiently 
light, it can appear in top quark decays t — > H + b @. 

Within the SM, the top quark decay into a W boson 
and a b quark occurs with almost 100% probability. The 
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tt final state signatures are fully determined by the W 
boson decay modes. Measurements of top quark pair 
production cross sections <7 t j in various channels [|| are 
potentially sensitive to the decay of top quarks to charged 
Higgs bosons. The presence of a light charged Higgs bo- 
son would result in a different distribution of ti events 
between different final states than expected in the SM. 

In this Letter we compare the number of predicted and 
observed events in various tt final states and derive 95% 
confidence level (CL) limits on the production of charged 
Higgs bosons from top quark decays. The analysis is 
based on data collected with the DO detector between 
August 2002 and February 2006 at the Fermilab Tevatron 
pp Collider at ^/s = 1.96 TeV. The analyzed datasets 
correspond to an integrated luminosity of about 1 fb _1 . 

The decay modes of the charged Higgs boson depend 
on the ratio of the vacuum expectation values of the two 
Higgs doublets, tan/3. For small values of tan/3 it is 
dominated by the decay to quarks, while for larger val- 
ues of tan/3 it is dominated by the decay to a r lep- 
ton and a neutrino. We consider three models for the 
charged Higgs boson decay: a purely leptophobic model, 
where the charged Higgs boson decays into a charm and a 
strange quark, a purely tauonic model, where the charged 
Higgs boson decays exclusively into a r lepton and a neu- 
trino, and a model where both decays can occur. In 
all models we fix the it cross section to the theoretical 
value within the SM and extract B(t — > H+b). In the 
case of the tauonic model, in addition we extract a t i and 
B{t —t H+b) simultaneously, thus yielding a limit with- 
out assuming a particular value of the tt cross section. 

A scenario in which the charged Higgs boson decays 
exclusively into quarks can be realized, for instance, in a 
general multi-Higgs-doublet model (MHDM) It has 
been demonstrated that such leptophobic charged Higgs 
bosons with a mass of about 80 GeV could lead to notice- 
able effects at the Tevatron if tan/3 < 3.5 []|. Moreover, 
large radiative corrections from SUSY-breaking effects 
can lead to a suppression of H+ — > t+v compared to 
H+ — ► cs 0. In that case, for small tan/3, hadronic 
charged Higgs decays can become large in both the two- 
Higgs-doublet (2HDM) [| and the minimal supersym- 
metric standard model (MSSM). 

For values of tan/3 > 20 we consider different mod- 
els leading to different branching ratios. Values of 
B(H+ — > cs) close to one are predicted in specific CP- 
violating benchmark scenarios (CPX) with large thresh- 
old corrections Q- For other models, the tauonic de- 
cays of the charged Higgs boson dominate at high tan/3, 
for example, in the m™ ax benchmark scenario @] where 
B(H + — > t+v) can be close to one. 



II. EVENT SELECTION AND ANALYSIS 
METHOD 

This search for charged Higgs bosons is based on the 
following tt final states: the dilepton (U) channel where 



both charged bosons (W+ or H + ) decay into a light 
charged lepton (£ = e or p) either directly or through the 
lcptonic decay of a r, the T+lepton (rt) channel where 
one charged boson decays to a light charged lepton and 
the other one to a r-lepton decaying hadronically, and the 
lepton plus jets (£+jets) channel where one charged boson 
decays to a light charged lepton and the other decays into 
hadrons. We select events to create 14 subchannels: (i) 
ee (n/J,) subchannel with two isolated high transverse mo- 
mentum (pr) electrons (muons) and at least two high pt 
jets; (ii) e/i subchannels with one isolated high px elec- 
tron and one muon and exactly one or at least two jets; 
(to) re (t/j,) subchannel with one high pt hadronically 
decaying r, one electron (muon) and at least two high 
Pt jets one of which is identified as a b jet; (iv) £+jets 
subchannels with one isolated high px electron (muon), 
exactly three or at least four high px jets, further split 
into subsamples with one or at least two 6-tagged jets. 
Details of the event selection and object reconstruction 
in the dilepton and tI channels can be found in Ref. 0] ; 
a more detailed description of the ^+jets channel and the 
combination are given in Ref. All event samples are 
constructed to be mutually exclusive. 

In the £+jets channel the main background consists 
of VF+jets production, with smaller contributions from 
multijet, single top quark and diboson production. The 
background contribution in the t£ channel is domi- 
nated by multijet events, while the most important back- 
ground in the 11 channel emerges from Z+jets produc- 
tion. The sample composition of all 14 subchannels, as- 
suming B(t -> W+b) = 1 (hence B(t ->■ H+b)=0), is 
given in Ref. 

The simulation of the VF+jets and Z+jets backgrounds 
as well as the tt signal with no charged Higgs boson decay 
is performed using ALPGEN [l0( for the matrix element 
calculation, followed by PYTHIA [ll[ for parton showering 
and hadronization. Diboson samples are generated using 
pythia, while single top quark events are simulated using 
the SINGLETOP [l2| generator. The generated events are 
processed through a GEANT-based [13| simulation of the 
DO detector and the same reconstruction programs used 
for the data. 

We simulate the signal containing charged Higgs 
bosons with the pythia Monte Carlo event genera- 
tor [ll[, separately for the decays tt — > W+bH~b (and 
its charge conjugate) and tt — > H+bH~b. The total 
signal selection efficiency is calculated as a function of 
B = B(t -> H+b) as given by: 

e tt = {^~B) 2 -e t i^ w + bw -i + 2B (1 — B)-e t j_ w + bH -i 

+ B ' e ti->H+bH-b ' (!) 

yielding the number of tt events as a function of B. The 
efficiencies ^tt^w+bH-b an d e tt^H+bH-b are evaluated for 
the assumed H+ decay modes. Figure [1] shows the num- 
ber of expected events for different values of B(t — ► H+b) 
assuming M H + = 80 GeV and either B(H+ — ► cs) = 1 
or B{H+ — > t+v) = 1, compared to the number of ob- 
served events in the considered channels. The ^+jets en- 
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III. EXTRACTION OF LIMITS ON B(t -> 
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l+jets 1 tag l+jets 2 tag dilepton x+lepton 



FIG. 1: Number of expected and observed events versus final 
state for M H + = 80 GeV assuming either exclusive t + v (a) 
or exclusive cs (b) decays of the charged Higgs boson. 



tries with one and two 6-tags represent the sum of four 
^+jets subchannels each (with different light lepton fla- 
vor and = 3 and > 4 jets). The dilepton contribution 
corresponds to the sum of the ee, /i/i and two e/x sub- 
channels, and the r+lepton one shows the sum of the 
re and r/z subchannels. For a non-zero branching ra- 
tio B(t — > H + b — > csb) the number of events decreases 
in the ^+jets, It and tI final states. In case of a non- 
zero branching ratio B(t — > — * r + vb) the number of 
predicted events increases in the t£ channel while it de- 
creases in all other channels. The latter are often called 
disappearance channels. 



The extraction of B(t — > H + b) is done by calculating 
the predicted number of events in 14 search subchannels 
for various charged Higgs boson masses and branching 
ratios, and performing a maximum likelihood fit to the 
number of observed events in data. We constrain the 
multijet background determined from control samples in 
the i?+jets and t£ channels by including Poisson terms in 
the likelihood function. We account for systematic uncer- 
tainties in the fit by modeling each independent source of 
systematic uncertainty as a Gaussian probability density 
function Q with zero mean and width corresponding to 
one standard deviation (SD) of the parameter represent- 
ing the systematic uncertainty. Correlations of system- 
atic uncertainties between channels are naturally taken 
into account by using the same parameter for the same 
source of systematic uncertainty. The parameter for each 
systematic uncertainty is allowed to float during the like- 
lihood fit. We maximize the likelihood function 
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C = Y[v(n l ,m l ) x IjT^nj.m,-) X JJ 0, SD) , 

«=1 3=1 fc=l 

(2) 

with V(n, m) representing the Poisson probability to ob- 
serve n events when m events are expected. The product 
runs over the subsamples i, and multijet background sam- 
ples j. K is the total number of independent sources of 
systematic uncertainty, with being the corresponding 
nuisance parameter. The predicted number of events in 
each channel is the sum of the predicted background and 
the expected ti events, which depends on B(t — + H + b). 

During the fit, the ti cross section is set to 7.48^072 P^j 
corresponding to an approximation to the next-to-next- 
to-leading-order (NNLO) QCD cross section that in- 
cludes all next-to-next-to-leading logarithms (NNLL) rel- 
evant in NNLO QCD_[l4[ at the world average top quark 
mass of 173.1 GeV [lfj- The uncertainty on the theoret- 
ical cross section includes the uncertainty on the world 
average top quark mass. 

Since we find no evidence for a charged Higgs bo- 
son, we extract upper limits on B(t — > H + b), assum- 
ing that B(H+ -> cs) = 1, or B(H+ -> t + v) = 1, or 
a mixture of both. The limit setting procedure follows 
the likelihood ratio ordering principle of Feldman and 
Cousins (l6| . The determination of the limits requires 
the generation of pseudo-datasets. We generate ensem- 
bles of 10,000 pseudo-datasets with B(t — > H + b) varied 
between zero and one in steps of 0.05, fully taking into 
account the systematic uncertainties and their correla- 
tions. 

Table Q] shows an example of the uncertainties on 
B(t -> H+b) for M H + = 80 GeV in the tauonic and 
leptophobic charged Higgs boson models. We consider 
systematic uncertainties originating from electron, muon, 
r and jet identification, r and jet energy calibration, &-jet 
identification, limited statistics of data or Monte Carlo 
samples, modeling of triggers, signal and background, 
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and integrated luminosity. To evaluate the signal mod- 
eling uncertainty we replace the SM tt sample generated 
with ALPGEN by the one generated with PYTHIA and take 
the difference in acceptance as systematic uncertainty. 
For both the tauonic and leptophobic model, the two 
main sources of systematic uncertainty on B{t — > H+b) 
are the uncertainty on the luminosity of 6.1% and the 
tt cross section, followed by the non-negligible uncertain- 
ties on signal modeling, b jet identification and jet energy 
scale. The former two are approximately of the same size 
as the statistical uncertainty. Since in the tauonic model 
we consider both appearance and disappearance chan- 
nels, some uncertainties affecting the signal and back- 
ground normalization cancel. Therefore, uncertainties 
on signal modeling, the tt cross section, lepton identi- 
fication and luminosity are reduced in the tauonic model 
compared to the leptophobic model. 



TABLE I: Uncertainties on B 
and tauonic model, assuming 



(t — > H + b) for the leptophobic 
M H + = 80 GeV. 



leptophobic 



Source 


+ 1 SD 


-1 SD 


+1 SD 


-1 SD 


Statistical uncertainty 


0.057 


-0.058 


0.047 


-0.046 


Lepton identification 





017 


-0 


017 





010 


-0 


010 


Tau identification 





004 


-0 


004 





006 


-0 


006 


Jet identification 





009 


-0 


009 





010 


-0 


010 


b jet identification 





031 


-0 


030 





030 


-0 


030 


Jet energy scale 





016 


-0 


019 





020 


-0 


020 


Tau energy scale 





004 


-0 


004 





004 


-0 


004 


Trigger modeling 





007 


-0 


011 





007 


-0 


006 


Signal modeling 





023 


-0 


024 





010 


-0 


010 


Background estimation 





013 


-0 


014 





011 


-0 


010 


Multijet background 





014 


-0 


016 





019 


-0 


017 







059 


-0 


085 





040 


-0 


054 


Luminosity 





056 


-0 


060 





035 


-0 


036 


Other 





017 


-0 


017 





010 


-0 


010 


Total systematic uncertainty 0.097 


-0.118 


0.071 


-0.079 



tauonic 



TABLE II: Expected and observed upper limits on the 
branching ratio B(t — > H+b) for each generated H + mass. 





leptophobic 


tauonic 


tauonic from 
simultaneous fit 


M H+ (GeV) 


exp 


obs 


exp 


obs 


exp obs a t t (pb) 


80 


0.25 


0.21 


0.18 


0.16 


0.14 0.13 8.07tl o4 


100 


0.25 


0.22 


0.17 


0.15 


0.13 0.12 8.11±l;£o 


120 


0.25 


0.22 


0.18 


0.17 


0.15 0.14 8.12t\m 


140 


0.24 


0.21 


0.19 


0.18 


0.18 0.19 8.26±l;ao 


150 


0.22 


0.20 


0.19 


0.19 


0.21 0.25 8.63±1:|| 


155 


0.22 


0.19 


0.19 


0.18 


0.24 0.26 8A9t\- 7 4 l 



Figure [2] shows the expected and observed upper lim- 
its on B(t — > H + b) assuming B(H+ — ► cs) = 1 or 
B(H+ — > t+v) = 1 as a function of M H + along with the 
one standard deviation band around the expected limit. 
Table [TT] lists the corresponding expected and observed 
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FIG. 2: Upper limit on B(t — > H + b) for the tauonic (a) and 
leptophobic (b) model versus M H +. The yellow band shows 
the ±1 SD band around the expected limit (Color version 
online) . 



upper limits on B(t — > H+b) for each generated M#+ . In 
the tauonic model we exclude B{t — > H+b) > 0.15 — 0.19 
and B(t -> H+b) > 0.19 - 0.22 in the leptophobic case. 

The CDF Collaboration reported a search for charged 
Higgs bosons using different tt decay channels with a data 
set of about 200 pb" 1 [13 , resulting in B(t -> H+b) < 
0.4 within the tauonic model. Recently, DO reported 
limits on B(t — ► H+b) for the tauonic and leptopho- 
bic models extracted from cross section ratios [1| and for 
the tauonic model based on a measurement of the tt cross 
section in l+jets channel using topological event informa- 
tion [l8[ . Exploring the full set of channels as presented 
here improves the limits derived in the cross section ratio 
method for the leptophobic and for the tauonic model in 
the high M H + region. 

We also extract upper limits on B(t — ► H+b) mixing 
the tauonic and leptophobic models under the assump- 
tion B(H+ -> t+v) + B(H+ -» cs) = 1. We repeat 
the extraction of upper limits on B(t — > H+b) in the 
range of < B(H+ — > t+v) < 1 in steps of 0.1. For 
each assumed M H + we parametrize the expected and ob- 
served limits dependent on the mixture between tauonic 
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and leptophobic decays. Figure [3] shows upper limits on 
B(t — > as a function of B(H+ — ► cs). As expected, 

the upper limit decreases with increasing tauonic decay 
fraction. 



IV. SIMULTANEOUS EXTRACTION OF 
B(t -> i2"+b) AND o- tt - 

The search for charged Higgs bosons in top quark de- 
cays is based on the distribution of ti events between the 
various final states. Naturally, it is also sensitive to the 
total number of ti events. This results in a large system- 
atic uncertainty due to the theoretical uncertainty in the 
ti cross section calculations. If a t i and B(t — > H + b) are 
measured simultaneously the limit becomes independent 
of the assumed theoretical ti cross section. Furthermore, 
the luminosity uncertainty and other systematic uncer- 
tainties affecting the signal normalization are partially 
absorbed by the fitted cross section. 

We perform a simultaneous fit of a t i and B(t — > H + b) 
for the tauonic model. The fitting and limit setting pro- 
cedure is the same as described in Sec. IIIIl with two free 
parameters instead of one. Table IIIIl shows the uncer- 
tainties on B(t -> H+b) and a ti for M H + = 80 GeV. 
The correlation between the two fitted quantities is about 
70% for M H + up to 130 GeV and it reaches 90% for 
M H + = 155 GeV. For high charged Higgs boson masses, 
where the correlation becomes high, the sensitivity de- 
grades compared to the case where the ti cross section is 
fixed. 

The ti cross section is set to the measured value in 
the generation of pseudo-datasets for the limit setting 
procedure. For the fit to the pseudo-data, a t i and B(t — > 
H+b) are allowed to float. In Table HTl the expected and 
observed upper limits on B(t — > H+b) are listed together 
with the simult aneous measurement of the ti cross section 
for a top quark mass of 170 GeV. Within uncertainties, 
the obtained cross section for all masses of the charged 
Higgs boson agrees with a t i — 8.18^0 8? P^j which was 
measured on the same data set assuming B(t — > W+b) = 

10- 

In Fig. 2] the upper limits on B(t — ► H+b) for M H + 
from 80 to 155 GeV are shown. For small M H +, the 
simultaneous fit provides an improvement of the sensi- 
tivity of more than 20% compared to the case where the 
ti cross section is fixed. Furthermore, the ti cross section 
measured here represents a measurement independent of 
the assumption B(t — > W+b) = 1. 

The simultaneous fit requires a reasonably small cor- 
relation between the two fitted observables. Since at 
present we have only included disappearance channels for 
the leptophobic model, the correlation between B(t — > 
H+b) and er t j is large (« 90%) for all charged Higgs bo- 
son masses, and thus we have not used the simultaneous 
fit method there. 



TABLE III: Uncertainties on B(t -> H+b) and a t i for the 
simultaneous fit in the tauonic model, assuming M H + — 
80 GeV. 





Bit -» 


H + b) 


o- t i 


(Pb) 


source 


i en 


i cn 


ii cr^ 


i cn 


Statistical uncertainty 


flfi7 
U.UO ( 


-U.UOD 


U.Do 


-U.04: 


Lepton identification 


0.001 


-0.001 


0.16 


-0.13 


Tau identification 


0.014 


-0.014 


0.12 


-0.13 


Jet identification 


0.005 


-0.005 


0.07 


-0.07 


b jet identification 


0.003 


-0.003 


0.31 


-0.29 


Jet energy scale 


0.014 


-0.014 


0.10 


-0.09 


Tau energy scale 


0.011 


-0.010 


0.10 


-0.08 


Trigger modeling 


0.009 


-0.000 


0.12 


-0.11 


Signal modeling 


0.014 


-0.016 


0.23 


-0.23 


Background estimation 


0.003 


-0.003 


0.15 


-0.14 


Multijet background 


0.036 


-0.033 


0.31 


-0.34 


Luminosity 


0.002 


-0.002 


0.57 


-0.48 


Other 


0.006 


-0.006 


0.17 


-0.17 


Total systematic uncertainty 


0.047 


-0.044 


0.84 


-0.77 



V. INTERPRETATIONS IN 
SUPERSYMMETRIC MODELS 

The limits on B(t — > H+b) presented in Figs. [H [3] 
and 0] are interpreted in different SUSY models and ex- 
cluded regions of [tan/3, M H +] parameter space are de- 
rived. The investigated MSSM benchmark models [|[ de- 
pend on several model parameters: \x is the strength of 
the supersymmetric Higgs boson mixing; MsuSY is a soft 
SUSY-breaking mass parameter representing a common 
mass for all scalar fermions (sfermions) at the electroweak 
scale; A = A t = At, is a common trilinear Higgs-squark 
coupling at the electroweak scale; X t — A — /i cot (3 is 
the stop mixing parameter; M% denotes a common SU(2) 
gaugino mass at the electroweak scale; and M3 is the 
gluino mass. The top quark mass, which has a significant 
impact on the calculations through radiative corrections, 
is set to the current world average of 173.1 GeV [HI]. 

Direct searches for charged Higgs bosons have been 
performed by the LEP experiments resulting into limits 
of M H + < 79.3 GeV in the framework of 2HDM [H[. 
Indirect bounds on M H + in the region of tan/3 < 40 
were obtained for several MSSM scenarios [2(J, two of 
which arc identical to the ones presented in Sect IV Cl and 
ED] of this Letter. 

A. Leptophobic model 

A leptophobic model with a branching ratio of 
B(H+ -► cs) = 1 is possible in MHDM Here 
we calculate the branching ratio B{t — > H+b) as a func- 
tion of tan (3, and the charged Higgs boson mass including 
higher order QCD corrections [21( using FeynHiggs [22[ . 
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FIG. 3: Upper limits on B(t — > H + b) parametrized as function of B(H + — > cs) for different assumed M H +. The yellow band 
shows the ±1 SD band around the expected limit (Color version online). 
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FIG. 4: Upper limit on B(t — > H + b) for the simultaneous fit 
of B(t — » H + b) and a t i versus M H + . The yellow band shows 
the ±1 SD band around the expected limit (Color version 
online). 



B. CPX model with generation hierarchy 

B(H + — > t + v) + B(H + — * cs) w 1 can be realized in 
a particular CPX benchmark scenario (CPX g h) 0] of the 
MSSM. This scenario is identical to the CPX scenario 
investigated in [2(| except for a different choice of arg(A) 
and an additional mass hierarchy between the first two 
and the third generation of sfermions which is introduced 
as follows: 



My 



Pjt M_ 



x 3 



(3) 



where X collectively represents the chiral multiplet for 
the left-handed doublet squarks Q, the right-handed up- 
type (down-type) squarks U (D), the left-handed doublet 
sleptons L or the right-handed charged sleptons E. Tak- 
ing pjj £ £ = 1, Pq q = 0.4 and requiring that the masses 
of the scalar left- and right-handed quarks and leptons 



TABLE IV: Summary of the most important SUSY parameter 
values (in GeV) for different MSSM benchmark scenarios. 



parameter 


CPXgh 


m?i-max 


no- mixing 


I 1 


2000 


200 


200 


Msusy 


500 


1000 


2000 


A 


1000 ■ exp(i7r/2) 






x t 




2000 





M 2 


200 


200 


200 


M 3 


1000 ■ exp(iTr) 


800 


1600 



Figure [5] shows the excluded region of [tan/3, M H +] pa- 
rameter space. For tan/3 = 0.5, for example, M H + up to 
153 GeV are excluded. For low M H +, values of tan/3 up 
to 1.7 are excluded. These are the most stringent limits 
on the [tan/3, M#-+] plane in leptophobic charged Higgs 
boson models to date. 



cr=L 
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B(H + -> C S)=1 

Expected 95% CL limit 

Excluded 95% CL region 

D0, L=1.0 fb" 1 




80 90 100 110 120 130 140 150 160 

M H+ [GeV] 

FIG. 5: Excluded regions of [tan/3, M H +] parameter space for 
leptophobic model. The yellow band shows the ±1 SD band 
around the expected limit (Color version online). 
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■■■Expected limit @ 95% CL 
□ Excluded region @ 95% CL 
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FIG. 6: Excluded region of [tan/3, M H +] parameter space in 
the MSSM for the CPX g h scenario with generation hierarchy 
such that B(H+ -> as) + B(H+ -> t+v) ~ 1. The yellow 
band shows the ±1 SD band around the expected limit (Color 
version online). 



are large Mq 3 q 3 = 2M^ 3 i 3 ^ 3 =2 TeV, we calculate 
the branching ratios B(t — > H+b) including higher or- 
der QCD and higher order MSSM corrections using the 
CPX gh MSSM parameters in Table [TV] The calculation 
is performed with the program CPsuperH [23[. Figure^ 
shows the excluded region in the [tan/3, M H +] parameter 
space. Theoretically inaccessible regions indicate parts 
of the parameter space where perturbative calculations 
cannot be performed reliably. In the [tan /3, Mjj+ ] re- 
gion analyzed here, the sum of the branching ratios was 
found to be B(H+ -> t+v) + B(H+ -> cs) > 0.99 ex- 
cept for values very close to the blue region which in- 
dicates B(H+ -> t+v) + B(H+ -> cs) < 0.95. The 
charged Higgs decay H+ — > t+v dominates for tan/3 be- 
low 22 and above 55. For the rest of the [tan/3, M H +] 
parameter space both the hadronic and the tauonic de- 
cays of charged Higgs bosons are important. In the re- 
gion 38 < tan /3 < 40, the hadronic decays of the charged 
Higgs boson dominate and B(H+ — ► cs) > 0.95. For 
large values of tan/3, M H + up to 154 GeV are excluded. 
For low charged Higgs masses, tan (3 values down to 23 
are excluded. These are the first Tevatron limits on a 
CP-violating MSSM scenario derived from the charged 
Higgs sector. 



C. No-mixing scenario 

In the CP-conserving no- mixing scenario, the stop mix- 
ing parameter X t is set to zero, giving rise to a relatively 
restricted MSSM parameter space. In the [tan/3, Mjj+\ 
parameter space analyzed here the branching ratio is 
B{H+ — > t+v) > 0.99 except for very low values of 
tan/3 and M H + where B(H+ -> t+v) > 0.95. We inter- 
pret the results derived in the tauonic model using the 
simultaneous fit in the framework of the no-mixing see- 
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FIG. 7: Excluded region of [tan/3, M H +] parameter space in 
the MSSM for the no- mixing scenario. The yellow band shows 
the ±1 SD band around the expected limit (Color version 
online). 



nario. The branching ratios B(t — > H+b) are calculated 
including higher order QCD and higher order MSSM cor- 
rections using the no-mixing MSSM parameters as given 
in Table HVl The calculation is performed with Feyn- 
HiGGS [22]. Figure [7] presents the excluded region of 
[tan/3, Mh+] parameter space. For large values of tan/3, 
M H + up to 145 GeV are excluded. For low M H + , values 
of tan (3 down to 27 are excluded. 



D. m^-max scenario 

In the CP-conserving m^-max scenario the stop mix- 
ing parameter is set to a large value, X t — 2Msusy- 
The theoretical upper bound on the lighter CP-even neu- 
tral scalar, mh, for a given value of tan/3 and fixed 
nit and Msusy is designed to be maximal. Therefore 
the model provides the largest parameter space in rrih 
and as a consequence, less restrictive exclusion limits 
on tan/3 than the other models. In the investigated 
[tan/3, M H +] parameter space, B(H+ — > t+v) > 0.99 
holds except for low values of tan/3 and M#+, where 
B(H+ — > t+v) > 0.97. Thus we use the simultaneous fit 
results within the tauonic model to derive constraints on 
the m/j-max scenario. The branching ratios B(t — > H+b) 
are calculated using FeynHiggs [22|| including higher 
order QCD and higher order MSSM corrections. The 
m/i-max MSSM parameters are given in Table HVl 

Figure [5] shows the excluded region of [tan/3, M H +] pa- 
rameter space. For large values of tan/3, M H + up to 
149 GeV are excluded. These are the most stringent lim- 
its from the Tevatron to date. For low charged Higgs 
boson masses, values of tan (3 down to 29 are excluded. 
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VI. SUMMARY 

We have performed a search for charged Higgs bosons 
in top quark decays. No indication for charged Higgs 
boson production in the tauonic or leptophobic model is 
found. Upper limits at 95% CL on the B(t -> H+b) 
branching ratios are derived in different scenarios de- 
pending on the values of B(H+ — > cs) and B(H+ — > 
t+v). For the leptophobic model, B(t -> H+b) > 0.22 is 
excluded for the M H + range between 80 and 155 GeV. 
For the tauonic model, B(t -> H+b) > 0.15 - 0.19 are 
excluded depending on M#+. In this model we have 
also performed a model-independent measurement and 
excluded B(t -> H+b) > 0.12 - 0.26 depending on M H +. 

We interpret the results in different models and exclude 
regions in [tan/3, Mjj+] parameter space. For the m^- 
max scenario, for example, M H + values up to 149 GeV 
are excluded. These are the most restrictive limits to date 
in direct searches for charged Higgs boson production in 
top quark decays. 
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